Periodic Neural Activity Induced by Network Complexity 
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We study a model for neural activity on the small-world topology of Watts and Strogatz and on the scale-free 
topology of Barabasi and Albert. We find that the topology of the network connections may spontaneously 
induce periodic neural activity, contrasting with chaotic neural activities exhibited by regular topologies. Pe- 
riodic activity exists only for relatively small networks and occurs with higher probability when the rewiring 
probability is larger. The average length of the periods increases with the square root of the network size. 
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PACS numbers: 05.45.Xt, 05.50.+q, 89.75.Da, 89.75.Fb 
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The human brain is the most fascinating processor, consist- 
ing of about ten billion neurons. These neurons are connected 
to each other by synapses, forming together the neural net- 
work. The synapses transmit stimuli through different concen- 
trations of Na + and K + ions. The neurons communicate with 
each other through electrical impulses. Each time a neuron 
is charged beyond a certain threshold by the connected neu- 
rons, it "fires" an electrical discharge through its axon which 
through synapses transmits charges to the dendrites of other 
neurons. While most synapses just connect close by neurons, 
a few of them also can be long range and connect to a neuron 
in a distant area of the brain. These few far-reaching connec- 
tions seem to be crucial for the coherent functioning of the 
brain. Such a mixed network structure of many short- and a 
few long-range connections is the trademark of small-world 
networks as introduced in a seminal work by Watts and Stro- 
gatz AS 01- m vitro studies of neuronal networks have in 
fact been grown and analyzed and found to have small-world 
properties |4|. Another direction of research has been ana- 
lyzing avalanches of neurons firing, reporting that there exists 
some criticality or scale-free behavior. This has been observed 
experimentally in organotypic cultures from coronal slices of 
rat cortex 0] and been modeled as a self-organized critical 
process ((J. 

In brain research, the appearance of periodic cycles of fir- 
ing sequences is commonly observed, being considered as re- 
sponsible for the origin of various body clocks or even been 
interpreted as the realization of some simple thoughts. One 
of the fundamental questions is how does such a seemingly 
disordered system as the brain synchronizes the activity as to 
produce these periodic signals. It is the aim of the present 
work to present a simple neural model on Watts-Strogatz and 
Barabasi- Albert networks and show that it can, under suitable 
circumstances, spontaneously generate periodic time series in 
its activity. Similar studies have already been performed using 
the Hodgkin-Huxley model where it was found that 

the Watts-Strogatz network has fast coherent oscillations as 
opposed to other types of graphs. Also integrate-and-fire neu- 
rons have been studied on small-world networks and a transi- 
tion between self-sustained persistent activity and failure has 
been reported 11(11 . Other properties like, for instance, the 
background of the neural activity, seem rather unaffected by 
the small world properties as observed recently Hill . We also 



want to take into account scale-free properties by investigat- 
ing our model on the network of Barabasi and Albert 11% [1311 . 
Among others, already the Hopfield model IT4I [I5I1 and the 
Hindmarsh-Rose neural model flr3l have been studied before 
on such networks. 

In order to describe the neural activity we use a variant of 
the original model of McCulloch and Pitts fl7il . A neuron i 
can be in two states, firing or non-firing, described by binary 
variables Xi = 1 (active) or Xi = (inactive). They are ini- 
tialized randomly. The state of a neuron is updated in time t 
through the following equation fTT 
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x i (t) = Q^S ij x j (t-l) + T), 
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where n is the number of connections of each neuron and SV, 
represents the strength of the synapse between neurons i and 
j. The strength factors Sij are set randomly to be either +1 
or —1 with equal probability, representing either an excitatory 
or an inhibitory neuron, respectively. The variable T is the 
firing threshold which in fact throughout this paper is taken to 
be zero. Here, 6 denotes the Heaviside function defined as 
usual: 6(z) = 1 if z > 0, and 6(z) = if z < 0. 

We are interested in analyzing the overall firing activity of 
the brain which in practice can be monitored, for instance, 
through EEG measurements. For that we define a macro- 
scopic variable of our model which we call the "neural ac- 
tivity" A(t) as the fraction of neurons firing at time t, 
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The small-world network of Watts and Strogatz Gl El 01 
allows one to continuously connect two extreme situations, 
namely the regular lattice and random graph of Renyi and 
Erdds The construction of a Watts-Strogatz network is 
performed in two steps: 

1. We start with a regular lattice, in our case a one- 
dimensional chain of N sites with connections between 
nearest and next-nearest neighbors and periodic bound- 
ary conditions so that the total number of connections 
per site is k = 4. 
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FIG. 1: One starts with a regular chain having nearest and 
next-nearest neighbor connections. With probability p we re- 
place short-range by long-range connections by rewiring: Ini- 
tially v is connected to v . But after rewiring, the connection 
of v to v' is replaced by another connection, say v to v" . 
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2. With probability p ("rewiring probability") we replace 
for each site i a connection Lij by another one L^ x 
where x is any randomly chosen site (Fig.Q. 

The rewiring probability p varies between zero and one and 
is the main parameter of our investigation. For p = we have 
a regular lattice and for p = 1 a random graph. 

The scale-free network of Barabasi and Albert (HQ is 
constructed by starting with a small number too of nodes at 
time t = 0. Then, at each time step one adds a new node 
having to < too links to the existing nodes. The probability 
that a new node is connected to node i is ki / ^ ■ kj where ki 
is the actual connectivity of node i. 

This rule assures preferential attachment to sites of higher 
connectivity. As a result the distribution of connectivities also 
called the "degree distribution" follows a power-law P(k) ~ 
k^ 1 with an exponent 7 = 3. This property characterizes a 
scale-free network. 

We first consider a network with N = 2048 sites and mod- 
ify the rewiring probability p between zero and one. For each 
value of p, we generate 1000 different networks and compute 
at each time step the neural activity A(t), Eq. (|2ji, as gener- 
ated by the model of Eq. Q Figure^ shows the non-periodic 
(chaotic) temporal evolution of the neural activity as obtained 
for a Watts-Strogatz network with rewiring probability p = 
(i.e. on a regular chain). In order to measure the periodicity in 
time, we analyze the last 1024 time steps of series with 16382 
steps using a shift algorithm In this way, it is possible to detect 
all periods shorter than 512 time steps. 

Figure^ shows the result when the rewiring probability is 
p = 1 (i.e. on a random graph): the time-series becomes peri- 
odic. To quantify the degree of periodicity <j>, i.e., the fraction 
of graphs that exhibit periodic time series, we performed ad- 
ditional simulations on networks with N = 1024, 2048, 4096, 
8192 and 16384 sites. For each size we generated 1000 dif- 
ferent networks and measured the degree of periodicity for 
various values of p. 

The inset of Figure [3] shows the fraction <f> of networks 
reaching a periodic regime as a function of the rewiring prob- 
ability p. For p = we find consistently = 0, i.e. all 



FIG. 2: Temporal evolution of the neural activity of graphs 
having 2048 sites, (a) for a rewiring probability p = 0, i.e. a 
regular network, (b) for a rewiring probability p = 1, i.e. a 
random graph. 
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FIG. 3: Renormalized fraction <f>'(N) of graphs with peri- 
odic time series as a function of the tanh of the renormalized 
rewiring probability p'(N). Inset: Fraction cj> of graphs with 
periodic time series as a function of the rewiring probability 
for different network sizes N . 



networks behave chaotically regardless of their size. Further- 
more, the solid lines clearly indicate that the increase of the 
fraction with p can be closely described by the expression, 
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<j)(j>, N) = qq tanh( h a^) — tanh(a2) 



(3) 



where the parameters do, cti and a-i are obtained through the 
best nonlinear fit to the data of Eq. (|3]for each different value 
of N. In addition, our results suggest that the parameters a.j 
depend only on the system size N, since we find their behav- 
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FIG. 4: Fraction <j> of graphs with periodic time series as a 
function of the size N of the graph for different values of p. 
The inset shows the data for the Barabasi-Albert network for 
m = 3. 
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FIG. 5: Double-logarithmic plot of the average period length 
for the Watts-Strogatz network as function of the size N of the 
network averaged over 1000 networks for p — 0.9. The inset 
shows the data for the Barabasi- Albert network for m — 3. 



iors to be well represented by the relations, 

a (N) =a + f3 N 

ai(N) = ax+fa. In TV 
a 2 (N) = a 2 + ySalnJV 



(4) 
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with a = 0.501, a x = 0.476, a 2 = 9.610, (3 = 
-4.146 x 10~ 5 , /3i = -0.036, and fa = -1.576. Fol- 
lowing this approach, we can rescale the variables <f> and p 
as cj)' = <f>/ao + tanh(a2) andp' = p/a± + a 2 , respectively, 
to show that all data can be collapsed on the top of each other 
as displayed in Fig. [5] From the inset in Fig.[3]we can also see 
that the degree of periodicity <f> decays with increasing size TV 
of the network for a fixed value of p > 0. 

As can be seen from Fig. |3j there exists a No ~ 32, 000 
defined through 4>'(Nq) = above which the fraction <f> of 
graphs with periodic signals is zero, Nq being the largest net- 
work size still showing periods. 

In Fig. [4] we show that the degree of periodicity <f> decays 
with the increase of the network size N, and that this effect 
becomes more pronounced the smaller is the value of p. 

The length of a period is the minimum number of time 
steps for which the time series is repeated. Figure[5]shows in 
double-logarithmic scale the average period length as a func- 
tion of the size N of the network for N = 128, 256, 512, 1024 
and 2048 for a fixed value of p = 0.9. For each value of N, 
we average over 1000 networks from series that have a total 
length of 16384 time steps, the last 1024 of which were ana- 
lyzed. We see that the average period (T) increases with the 
size like a power law, with an exponent that is approximately 
equal to 1/2, i.e., (T) oc \/N. 



In the insets of Figs.|4]and[5]we see the corresponding data 
for a Barabasi-Albert network with m = 3. Here the fraction 
of graphs having periodic signals decreases with the system 
size N linearly and at around Nq « 6000 it becomes zero 
so that for larger sizes no periods can be found. The average 
period length increases linearly with the size: (T) oc N. 

In conclusion, we have shown that a simple neural model 
on Watts-Strogatz and Barabasi-Albert networks can gener- 
ate periodic activity signals, however, only if the networks 
are not too large. These cycles become more frequent if one 
has more long-range connections, and the length of their pe- 
riod increases like the number of neurons or its square root 
for scale-free or small-world networks respectively. Since the 
brain is huge one would therefore expect the present mecha- 
nism to be only relevant in very small fractions of the brain. In 
particular one can imagine that our discovery is important to 
explain periodic signals for instance in pace makers, nervous 
systems of lower animals or other very small units of neurons. 

The brain is one of the big challenges of our century and 
still full of mysteries and contradictions. From EEG and di- 
rect measurements with electrodes we know that cycles of fir- 
ing do appear. Their role and their origin are still not clear. 
Of course they are only finite in length and a perfect period- 
icity has also not yet been confirmed. Our finding proposes at 
least one mechanism that might explain their origin. We see 
that on small scales the network complexity, be it scale-free or 
small- world can spontaneously generate periodic signals. We 
have evidence that real neural networks do have both aspects. 
In particular small-world topology has been experimentally 
evidenced. Small units of neurons could be the nucleus that 
generates periodic signals using the mechanism found in our 
work. How they interact with the rest of the brain is not clear 
and it would be interesting to study this in more detail. We 
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also propose to investigate the spatial distribution of periodic 
signals to ask the question if they could be localized in space 
or if they are collective excitations. Larger systems should 
be studied investing more CPU time. Another aspect we will 
study in the future is the effect of pinning. What happens 
when one neuron has an externally controlled fixed signal (e.g. 
firing all the time). Can we suppress or induce oscillations in 
this way? As they stand our results concern small units of 
neurons and an experimental verification could be imagined 
with brains of low animals or with in vitro cultures. One di- 



rect application could be the pace-maker of the heart which is 
indeed a neural net providing a perfectly periodic signal over 
very long times. 
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